Papers with data acquisition
Empowering Tabular Data Preparation with Language Models: Why and How? (2026.acl-long)
Copied to clipboard
Mengshi Chen, Yuxiang Sun, Tengchao Li, Jianwei Wang, Kai Wang, Xuemin Lin, Ying Zhang, Wenjie Zhang
| Challenge: | Tabular data preparation is a critical step in enhancing the usability of tabular data. |
| Approach: | They analyze how LMs can be combined with other components for different tabular data preparation tasks. |
| Outcome: | The proposed methods lack the ability to capture the relationships within tables and adapt to the tasks involved. |
Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain Dialogue State Tracking (2020.acl-main)
Copied to clipboard
| Challenge: | Existing techniques for zero-shot transfer learning for multi-domain dialogue state tracking are expensive and require human errors, delays in annotation, and normalization issues. |
| Approach: | They propose a zero-shot transfer learning technique where training data are synthesized from an abstract dialogue model and the ontology of the domain. |
| Outcome: | The proposed technique improves the state of the art on the multi-domain dialogue state tracking dataset by 21%. |
Efficient Continual Pre-training of LLMs for Low-resource Languages (2025.naacl-industry)
Copied to clipboard
| Challenge: | Open-source large language models (LLMs) are a promising tool for low-resource languages . however, there is still a substantial performance gap between high-resourced languages and LRLs . |
| Approach: | They develop an algorithm to select a subset of texts from a larger corpus and use it to select tokens for LLMs. |
| Outcome: | The proposed algorithm reduces the cost of continual pre-training (CPT) with large amounts of language-specific data. |
RoT: Enhancing Table Reasoning with Iterative Row-Wise Traversals (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in reasoning large language models (RLLMs) have significantly enhanced reasoning capabilities, leading to brilliant performance on table reasoning. |
| Approach: | They propose a method which performs iterative row-wise table traversal, allowing for reasoning extension and reflection-based refinement at each traversal. |
| Outcome: | Experiments show that the proposed method outperforms RLLMs on WikiTableQuestions and TableBench by 4.3% and achieves state-of-the-art results with comparable models. |
LM-Interview: An Easy-to-use Smart Interviewer System via Knowledge-guided Language Model Exploitation (2024.emnlp-demo)
Copied to clipboard
| Challenge: | Semi-structured interviews are a crucial method of data acquisition in qualitative research. |
| Approach: | They propose a semi-structured interview system that automates interview preparation, analysis and control by interviewers. |
| Outcome: | Experimental results show that LM-Interview performs comparable to human interviewers . the system can be used to analyze semi-structured interviews without interviewers' involvement . |
Empirical Analysis of Noising Scheme based Synthetic Data Generation for Automatic Post-editing (2022.lrec-1)
Copied to clipboard
| Challenge: | Automatic post-editing (APE) is a research field that aims to correct errors in translated sentences regardless of the utilized machine translation system. |
| Approach: | They propose a method for automatically generating APE data based on a noising scheme from a parallel corpus. |
| Outcome: | The proposed method shows that depending on the type of noise, the noising scheme-based APE data generation may lead to inferior performance. |
A New Massive Multilingual Dataset for High-Performance Language Technologies (2024.lrec-main)
Copied to clipboard
Ona de Gibert, Graeme Nail, Nikolay Arefyev, Marta Bañón, Jelmer van der Linde, Shaoxiong Ji, Jaume Zaragoza-Bernabeu, Mikko Aulamo, Gema Ramírez-Sánchez, Andrey Kutuzov, Sampo Pyysalo, Stephan Oepen, Jörg Tiedemann
| Challenge: | a new massive multilingual dataset is available for language modeling and machine translation training. |
| Approach: | They present a massive multilingual dataset using web crawls from the Internet Archive and CommonCrawl . they use open-source software tools and high-performance computing to acquire, manage and process large corpora . |
| Outcome: | The HPLT language resources is a massive multilingual dataset . it includes monolingual and bilingual corpora extracted from CommonCrawl and the Internet Archive . the results are published online at the journal journal cense4 . |
FlexDoc: Parameterized Sampling for Diverse Multilingual Synthetic Documents for Training Document Understanding Models (2025.emnlp-industry)
Copied to clipboard
Karan Dua, Hitesh Laxmichand Patel, Puneet Mittal, Ranjeet Gupta, Amit Agarwal, Praneet Pabolu, Srikant Panda, Hansa Meghwani, Graham Horwood, Fahad Shah
| Challenge: | Document understanding models require large, diverse, and well-annotated datasets that can cost millions of dollars to collect and maintain. |
| Approach: | They propose a scalable synthetic data generation framework that combines Stochastic Schemas and Parameterized Sampling to produce realistic, multilingual semi-structured documents with rich annotations. |
| Outcome: | Experiments on key information extraction tasks show that the proposed framework improves the absolute F1 score by up to 11% while reducing annotation effort by over 90% compared to traditional hard-template methods. |
Large-scale Cross-lingual Language Resources for Referencing and Framing (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing corpora that capture language but do not represent actual situations hinder development of systems to resolve cross-document coreference. |
| Approach: | They introduce the concept of cross-lingual referential corpora and propose a framework to analyze framing . they expect to capture larger variation in framation compared to traditional approaches . |
| Outcome: | The proposed project will analyze the framing of incidents in different languages and texts . it expects to capture larger variation in framation compared to traditional approaches . |
Speech Foundation Models and Crowdsourcing for Efficient, High-Quality Data Collection (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for crowdsourcing data collection require a human workforce, which is hard to sustain. |
| Approach: | They propose to use Speech Foundation Models to automate validation processes . they find that SFMs can reduce reliance on human validation . |
| Outcome: | The proposed model reduces the reliance on human validation without degrading the quality of the final data. |
PerCQA: Persian Community Question Answering Dataset (2022.lrec-1)
Copied to clipboard
| Challenge: | Community Question Answering (CQA) forums provide answers to many real-life questions. |
| Approach: | They propose to make Persian dataset PerCQA public to encourage more research in Persian CQA. |
| Outcome: | The proposed dataset contains 989 questions and 21,915 annotated answers from the most well-known Persian forum. |
Transfer and Active Learning for Dissonance Detection: Addressing the Rare-Class Challenge (2023.acl-long)
Copied to clipboard
Vasudha Varadarajan, Swanie Juhng, Syeda Mahwish, Xiaoran Liu, Jonah Luby, Christian Luhmann, H. Andrew Schwartz
| Challenge: | Active learning has been proposed to alleviate data acquisition challenges for rare-class tasks when the class label is very infrequent (e.g., 5% of samples). |
| Approach: | They propose to use transformers to train models on closely related tasks and evaluate acquisition strategies, including a proposed probability-of-rare-class approach to dissonance detection. |
| Outcome: | The proposed method improves model accuracy while iterative transfer-learning does not improve cold-start performance. |
PMIndiaSum: Multilingual and Cross-lingual Headline Summarization for Languages in India (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing datasets for Indian languages are limited in terms of coverage and size. |
| Approach: | They propose a multilingual and massively parallel summarization corpus focused on languages in India that provides a training and testing ground for four language families, 14 languages, and the largest to date with 196 language pairs. |
| Outcome: | The proposed dataset provides a training and testing ground for four language families, 14 languages, and the largest to date with 196 language pairs. |